|
|
Cross-Domain Aspect-Level Sentiment Analysis Based on Adversarial Distribution Alignment |
DU Yongping1, LIU Yang1, HE Meng1 |
1. Faculty of Information Technology, Beijing University of Technology, Beijing 100124 |
|
|
Abstract The source domain data with rich sentiment labels is utilized to classify the aspect-level sentiment polarity for the target domain data without labels. Therefore, a cross-domain aspect-level sentiment classification model based on adversarial distribution alignment is proposed in this paper. The interactive attention of aspect words and context is employed to learn semantic relations, and the shared feature representations are learned by domain classifiers based on gradient reversal layers. The adversarial training is conducted to expand the alignment boundary of the domain distribution. And then the misclassification problem caused by fuzzy features is alleviated effectively. The experimental results on Semeval-2014 and Twitter datasets show that the performance of the proposed model is better than other classic aspect-level sentiment analysis models. The ablation experiment proves that the classification performance can be improved significantly by the strategy of capturing fuzzy features of decision boundary and expanding the distance between sample and decision boundary.
|
Received: 03 September 2020
|
|
Fund:National Key Research and Development Program of China(No.2019YFC1906002), Research Program of State Language Commission(No.YB135-89) |
Corresponding Authors:
DU Yongping, Ph.D., professor. Her research interests include information retrieval, information extraction and natural language processing.
|
About author:: LIU Yang, master student. His research interests include natural language processing and sentiment analysis. HE Meng, master student. Her research interests include natural language processing and sentiment analysis. |
|
|
|
[1] WANG Y Q, HUANG M L, ZHU X Y, et al. Attention-Based LSTM for Aspect-Level Sentiment Classification // Proc of the Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL, 2016: 606-615. [2] MA D H, LI S J, ZHANG X D, et al. Interactive Attention Networks for Aspect-Level Sentiment Classification // Proc of the 26th International Joint Conference on Artificial Intelligence. Palo Alto, USA: AAAI Press, 2017: 4068-4074. [3] 曾义夫,蓝 天,吴祖峰,等.基于双记忆注意力的方面级别情感分类模型.计算机学报, 2019, 42(8): 1845-1857. (ZENG Y F, LAN T, WU Z F, et al. Bi-memory Based Attention Model for Aspect Level Sentiment Classification. Chinese Journal of Computers, 2019, 42(8): 1845-1857.) [4] XUE W, LI T. Aspect Based Sentiment Analysis with Gated Convolutional Networks // Proc of the 56th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, USA: ACL, 2018: 2514-2523. [5] 孙小婉,王 英,王 鑫,等.面向双注意力网络的特定方面情感分析模型.计算机研究与发展, 2019, 56(11): 2384-2395. (SUN X W, WANG Y, WANG X, et al. Aspect-Based Sentiment Analysis Model Based on Dual-Attention Networks. Journal of Computer Research and Development, 2019, 56(11): 2384-2395.) [6] 赵传君,王素格,李德玉,等.基于分组提升集成的跨领域文本情感分类.计算机研究与发展, 2015, 52(3): 629-638. (ZHAO C J, WANG S G, LI D Y, et al. Cross-Domain Text Sentiment Classification Based on Grouping-AdaBoost Ensemble. Journal of Computer Research and Development, 2015, 52(3): 629-638.) [7] 庄福振,罗 平,何 清,等.迁移学习研究进展.软件学报, 2015, 26(1): 26-39. (ZHUANG F Z, LUO P, HE Q, et al. Survey on Transfer Learning Research. Journal of Software, 2015, 26(1): 26-39.) [8] ZHANG K, ZHANG H F, LIU Q, et al. Interactive Attention Transfer Network for Cross-Domain Sentiment Classification // Proc of the 33rd AAAI Conference on Artificial Intelligence. Palo Alto, USA: AAAI Press, 2019: 5773-5780. [9] HU M T, WU Y K, ZHAO S W, et al. Domain-Invariant Feature Distillation for Cross-Domain Sentiment Classification // Proc of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. Stroudsburg, USA: ACL, 2019: 5559-5568. [10] LI Z, LI X, WEI Y, et al. Transferable End-to-End Aspect-Based Sentiment Analysis with Selective Adversarial Learning // Proc of the Conference on Empirical Methods in Natural Language Proce-ssing and the 9th International Joint Conference on Natural Language Processing. Stroudsburg, USA: ACL, 2019: 4590-4600. [11] PENNINGTON J, SOCHER R, MANNING C D. GloVe: Global Vectors for Word Representation // Proc of the Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL, 2014: 1532-1543. [12] VASWANI A, SHAZEER N, PARMAR N, et al. Attention Is All You Need // Proc of the 31st International Conference on Neural Information Processing Systems. Cambridge, USA: The MIT Press, 2017: 6000-6010. [13] PONTIKI M, GALANIS D, PAVLOPOULOS J, et al. SemEval-2014 Task 4: Aspect Based Sentiment Analysis // Proc of the 8th International Workshop on Semantic Evaluation. Stroudsburg, USA: ACL, 2014: 27-35. [14] DONG L, WEI F R, TAN C Q, et al. Adaptive Recursive Neural Network for Target-Dependent Twitter Sentiment Classification // Proc of the 52nd Annual Meeting of the Association for Computational Linguistics. Stroudsburg, USA: ACL, 2014: 49-54. [15] CHEN P, SUN Z Q, BING L D, et al. Recurrent Attention Network on Memory for Aspect Sentiment Analysis // Proc of the Con- ference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL, 2017: 452-461. [16] LIU Q, ZHANG H B, ZENG Y F, et al. Content Attention Model for Aspect Based Sentiment Analysis // Proc of the World Wide Web Conference. New York, USA: ACM, 2018: 1023-1032. |
|
|
|